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0 Method and apparatus for reprosenjifig motion of multiple-Jointed object, computer graphic 
apparatus, and robot controller. 



0 A bending angle of each joint (3, 4. 5) of a multiple-jointed object (1) is represented with a function (functions 
(1) to (4)) independent of a length between joints of the object. Based on the function, contour data is produced 
for a motion of each joint, which Is then displayed on a screen (17). This unnecessitates the operation which has 
been conventionally achieved to generate functions each time the object is changed in its size. Namely, the 
functions are independent of the size of the object. Since parameters (D„. A„,n. ^mn. m. n. of the functions 
are altered to additionally assign characteristics to changes in the bending angles of the respective joints, the 
object can be actuated in an action having an emotional expression. 
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BACKGROUND OF THE INVENTION 

The present invention relates to a method of representing a nr>otion in which a motion of a multiple- 
articulated object such as a human or an animal is represented, and in particular, to a motion representation 
method, a motion representing apparatus, a computer graphic apparatus, and a robot controller suitable for 
facilitating an operation to set and to change a motion of the multiple-hinged object when a size thereof Is 
altered and for enabling various kinds of motions to be represented. 

In order to represent In computer graphics such motions as walking and running actions of a human 
and motions of a horse and a spanworm. a key frame method has been employed in general. According to 
the key frame method, to generate motions of a multiple-articulated object such as a human or a horse, the 
user first defines contours thereof at a point of time and at a subsequent point of time, respectively. 
Contours between these periods are determined based on an interpolation so that the respective contours 
or shapes thus attained are sequentially displayed In a time-series manner to resultantly produce a motion 
picture in which the multiple-jointed object seems to make a real action. However, the key frame method is 
attended with a problem that the coritours thus determined in the time-series manner for the motion of the 
object takes a long period of time, which hence requires a considerably large amount of processing time 
and which imposes a heavy toad on the operator. 

Heretofore, to overcome this problem, as described in an article entitled "A Study of Computer 
Animation Composed of Animation Primitives by Trigonometric Motion Approximation" written in the 
Proceedings of lECE of Japan. Jan. 1980. Vol. J63-D No. 1. an action of a human is shot by a camera to 
attain an animation picture thereof on a 16 millimeter (mm) film so as to measure movements of 
representative points of joints or articulations. For each joint portion above, horizontal and vertical positions 
X and Y thereof are obtained in centimeters relative to reference positions in a form of a function of time T, 
thereby determining a locus of the movement of each joint portion. Thereafter, the locus of the movement is 
approximated by a straight line and a trigonometric curve such that the computer system achieves 
computations on the approxiamted curve to attain respective contour data items in a time sequence, which 
are then sequentially displayed as a motion picture in the graphic system. 

According to the prior art above, the movement of each articulation thus obtained through the shooting 
operation on a 16 mm film is analyzed to extract changes in the X-directional and Y-directional positions 
relative to the respective reference positions at each point of time, thereby determining the approximated 
curve of the motion of the human. Consequently, a satisfactory animation picture is developed when the 
action is to be expressed by the approximated curve. However, the approxiamted curve cannot be applied 
to a case, for example, where the size of the object is varied or where dimensional ratios between the 
respective joints are altered in the motion. In this case, there arises a problem that the shooting operation is 
required to be again actually achieved on the object with the pertinent size and/or with the associated ratio 
between the joints, which leads to a limited degree of freedom for representing the animation. That is, 
according to the conventional technology, when generating a motion picture of a multiple-jointed object in 
the computer graphic system, the image can be presented only as an analogy of the real object thus 
undergone the shooting operation. This means that various actions cannot be developed in computer 
graphics. For example, only an ordinary walking action of a human shot by the camera can be displayed In 
the graphic Image. Namely, even when the ordinary or standard action Is modified, a motion picture of, for 
example, a violent walking action or a joyful or pleasant walking motion cannot be obtained. In con- 
sequence, heretofore, to express such an action above, for example, a human model is required to actually 
walk with a violent feeling to be shot by a camera so as to attain an image of the violent walk, which is then 
analyzed to implement an objective animation picture. In other words, for example, when producing a 
motion picture of animals, insects, and Imaginary objects of which various actions cannot be actually shot 
by a camera, various movements thereof cannot be easily presented in computer graphics. 

In addition, it has been Impossible in the conventional technology to produce an action with a human 
sentimental feature, which is usually expressed, for example, by a feature. That is. a characteristic action 
with a human emotion cannot be reflected on animation picture of the multiple-jointed object. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide a motion representation method and a 
computer graphic apparatus in which even when a size of a muttiple-jointed object and/or a dimensional 
ratio between joints thereof are altered, a motion of the object can be easily changed in computer graphics. 

Another object of the present invention is to provide a motion representation method and a computer 
graphic apparatus in which a multiple-articulated object can achieve various motions such as those having 
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characteristics of actions of the object in computer graphics. 

Still another object of the present invention is to provide a method of and an apparatus for controlling a 
robot In which an action of the robot can be determined Independent of a size thereof and in which 
instructions of various motions can be issued to the robot, thereby solving a problem, similar to that 
5 described above, appearing when the rotx>t is actually operated for various actions. 

A first feature of the present Invention resides in that in a case where a motion of a multiple-articulated 
object Is presented on a display screen by controlling an action of each joint of the object, a bending angle 
of each articulation is expressed by a function independent of a length between articulations such that data 
of a contour of the multiple-jointed object in motion are obtained from the function, thereby displaying an 
10 image of the object according to a change In a size and/or a dimensional ratio between joints thereof. 

A second feature of the present invention resides suitably in that in a case where a motion of a 
multiple-jointed object is presented on a display screen by controlling an action of each joint of the object, a 
bending angle of each articulation is expressed by the following function independent of a length between 
articulations. 
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m m _ . mn mn m*n 

n=i 



(1) 



Dm: Direct-current component 
Pimn' Amplitude of each frequency component 
^mn: Phase 
25 m: Joint numt)er 

n: Higher harmonic of n-th order 

Phase difference off 1st order higher harmonics between reference joint and m-th joint = 0 
for reference joint) 

Data of a contour of the multiple-jointed object in motion are obtained from values of the function $m(t) 
30 for each joint. 

A third feature of the present invention resides in that when a motion of a multiple-jointed object is 
presented on a display screen by controlling an action of each joint of the object, a bending angle of each 
articulation is expressed by a function independent of a length between articulations and components of the 
respective functions are modified when presenting the motion of the object. 

35 A fourth feature of the present invention resides in that in the function (1), at least either one of the 
parameter values of D^, A„»n, and ischanged. 

A fifth feature of the present invention resides in that in a robot control operation in which instructions of 
operations are supplied to a multiple-jointed robot so as to instruct the robot to achieve a desired motion, a 
bending angle of each articulation is expressed by a function independent of a length between articulations 

40 such that positional data is computed for each joint of the robot based on the function, thereby producing 
the operational instructions. 

A sixth feature of the present invention resides in that a bending angle of each joint of a multiple-jointed 
object is expressed by a function Independent of a length between joints so as to reflect onto the function a 
feature of a motion such as one expressed by an element of a human emotion which may be linguistically 

45 represented by a feature. 

A seventh feature of the present Invention resides in that when presenting a motion of a multiple-jointed 
object on a display screen by controlling an action of each joint of the object, the action of the object is 
expressed by a function of time. Means for changing parameters disposed to develop various kinds of 
motions includes at least either one of means for otrtaining a mean value of parameters of each function of 

50 time representing a plurality of actions, means for controlling a direction or an orientation of the multiple- 
jointed object, means for creating a route of a motion, means for changing a stride length between an Inner 
side and an outer side of a curve, means for taking into consideration an infiuence of a centrifugal force, 
means for controlling a stride length in the motion, means for interpolating the function of time with respect 
to space, means for combining an action created in the key frame method with an action generated from 

55 the function of time, means for producing a function of time from measured data, means for generating a 
function of time from the action created in the key frame method, and means for correcting the function of 
time. 

As atK)ve, when a bending angle of each articulation of a multiple-hinged object is expressed by a 
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function, the angle can be independent of a length t)etween articuaftions. Consequently, in a case when a 
contour of the multiple-jointed object to be displayed is computed depending on the bending angle of each 
joint, the computation can be accomplished independently of the size of the object, namely, the function 
need not be prepared again for the computation. In consequence, even when the multi-articulated object is 
changed in its size, the computation of the contour thereof can be carried out by use of the functions 
beforehand prepared. Moreover, to change the representation of the motion, the user need only modify 
parameters of the functions to alter, for example, a change rate of the bending angle of each joint. 

Furthermore, when computing mean values of the respective parameters of the functions of time 
representing a plurality of actions in the motion representation, the motion can be represented depending 
on a mean value of a plurality of functions of time. 

The user may control the proceeding direction of the motion by adjusting the direction of the multiple- 
articulated object. 

The object can be arbitrarily moved or displaced in a space based on a route of the motion beforehand 
prepared. 

The inching width is varied between the inner and outer sides of a curve and hence the slip of a foot is 
prevented. 

Owing to the influence of the centrifugal force taken into consideration, an inclination of a body can be 
presented in a circular motion. 

The numfcjer of steps in an interval can be controlled depending on a stride width supervised in a 
movement. 

Based on an interpolation of a function of time with respect to a space, the motion can be altered while 
the object is being moved. Depending on an interpolation of a function of time with respect to time, the 
motion can be varied depending on an elapsed time. 

By combining a motion produced in the key frame method with one created from a function of time, 
there can be represented a motion which cannot be represented only from the function of time. 

Measured data are processed to generate a function of time, which enables an actual motion to be 
produced depending on the function of time. 

A function of time is created from a motion obtained in the key frame method and hence an imaginary 
action not actually existing in the accessible environment can be produced from the function of time. 

A function of time can t>e conrected by interpolating the function of time. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Rg. 1 is a schematic diagram showing the configuration of a computer graphic apparatus in a first 
embodiment according to ftre present invention; 

Rg. 2 is a diagram showing the display screen layout of the computer graphic apparatus; 
Rg. 3 is a diagram showing an image of a human in a line drawing; 

Rg. 4 is a graph presenting measured values of a change in the bending angles of primary joints of the 
human; 

Rg. 5 is a graph showing a spectrum related to a curve 3a of Rg. 4; 

Rg. 6 is a schematic diagram showing the configuration of a computer graphic apparatus in a second 
embodiment according to the present invention; 

Rg. 7A is a graph, identical to the curve 3a of Rg. 4, presenting ttie bending angle change of a knee 
articulation in an ordinary walking action; 

Rg. 7B is a graph showing ttie bending angle change of a knee articulation in a joyful walking action; 

Rg. 8 is a graph showing a spectrum related to the curve of Rg. 7B; 

Rg. 9 is a graph showing a difference between spectra of Rgs. 5 and 8, respectively; 

Rg. 10 is a schematic diagram showing the configuration of a computer graphic apparatus in a third 

embodiment according to the present invention; 

Rg. 11 is a schematic diagram showing the configuration of a computer graphic apparatus in a fourth 
embodiment according to the present invention; 

Rg. 12 is a diagram showing the constitution of a control system of a multiple-jointed object in a fifth 
embodiment according to the present invention; 

Rg. 13 is a diagram showing ttie configuration of a control system of a multiple-jointed object in a sixtti 
embodiment according to the present invention; 

Rg. 14 is a diagram showing the constitution of a control system of a multiple-jointed object in a seventh 
embodiment according to the present invention; 

Rg. 15 is a diagram showing the configuration of a control system of a multiple-jointed object in a eightti 
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embodiment according to the present invention; 

Fig. 16 is a diagram illustratively showing a relationship between a transit point and a moving direction; 
Rg. 17 Is a diagram showing the configuration of a control system of a multiple-jointed object in a ninth 
embodiment according to the present invention; 

Rg. 18 is a diagram showing relationships between transit points and a moving direction; 

Rg. 19 is a diagram showing the configuration of a control system of a multiplHointed object in a tenth 

embodiment according to the present invention; 

Rg. 20 is a diagram showing relationship of strides in a movement along a curve; 

Rg. 21 is a diagram showing the configuration of a control system of a multiple-jointed object in an 11th 

embodiment according to the present invention; 

Rg. 22 is a diagram schematically showing components of force applied onto a human in a circular 
motion; 

Rg. 23 is a diagram showing a conrection of a human posture; 

Rg. 24 is a diagram showing the configuration of a control system of a multiple-Jointed object in a 12th 
embodiment according to the present invention; 

Rg. 25 is a diagram showing the configuration of a control system of a muftipl^jointed object in a 13th 
embodiment according to the present invention; 

Rg. 26 is a diagram showing a relationship between a moving route and a stride length; 

Rg. 27 is a diagram showing the constitution of a control system of a multiple-jointed object in a 14th 

embodiment according to the present invention; 

Rg. 28 is a diagram schematically showing relationships between periods of time and stride lengths; 
Rg. 29 is a diagram showing the configuration of a control system of a murtiple-jointed object in a 15tti 
embodiment according to the present invention; 

Rg. 30 is a diagram showing ttie constitution of a control system of a multiple-jointed object in a leth 
embodiment according to the present invention; 

Rg. 31 is a diagram showing the configuration of a control system of a multiple-jointed object in a 17th 
embodiment according to the present invention; 

Fig. 32 is a diagram illustratively showing an interpolation of an image during a displacement ttiereof; 
Fig. 33 is a diagram showing tiie configuration of a control system of a multiple-jointed object in an 18th 
emtxxJiment according to the present invention; 

Fig. 34 is a diagram showing an interpolation of a motion with respect to time; 

Fig. 35 is a diagram showing ttie constitution of a control system of a multiple-jointed object in a 19th 
embodiment according to the present invention; 

Rg. 36 is a diagram showing the configuration of a control system of a multiple-jointed object in a 20tti 
embodiment according to the present invention; 

Fig. 37 is a diagram showing the constitution of a system in which a function of time is created from 
measured data; 

Fig. 38 is a schematic diagram showing a method of generating a function of time representing a motion; 
Fig. 39 is a diagram showing another system in which a function of time is produced from measured 
data; 

Fig. 40 is a diagram showing still another system in which a function of time is generated from data 
measured in the key frame method; 

Fig. 41 is a diagram showing ttie configuration of a system for conrecting a data base; 

Fig. 42 is a diagram showing tiie configuration of a control system of a muWple-jointed object in a 21st 

embodiment according to the present invention; 

Rg. 43 is a diagram showing ttie operation of an editing section of ttie embodiments above in which 
various parameters are supplied from a display screen; 

Fig. 44 Is a diagram illustratively showing a screen example employed to specify expressions of a 
motion; 

Fig. 45 is a diagram showing an example of a screen used to specify a route and a speed of an action in 
the motion editor; 

Rg. 46 is a diagram showing a screen example adopted to correct a motion obtained by the key frame 
method in the motion editor; 

Fig. 47 is a block diagram showing the configuration of a control system of a multiple-jointed object in a 

22nd emtKKJiment according to the present invention; and 

Fig. 48 is a schematic perspective view showing ttie constitution of a robot. 
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Referring now to the drawings, description will be given of embodiments according to the present 
invention. 

Rg. 1 shows the configuration of a computer graphic apparatus in a first embodiment according to the 
present Invention. In this system, as shown in Rg. 2, an example of a multiple-jointed object i.e. a human is 
presented in an animation picture of a multiple-articulated object 1 on a display screen such as a CRT. In 
operation of the computer graphic apparatus, the multiple-hinged object 1 is represented as a multiple- 
jointed object in a linework as shown in Rg. 3. In this line drawing, a bending angle of each joint (a coxa 2, 
a knee joint 3, an elbow joint 4, and a shoulder joint 5 in the example of Rg. 3) is controlled to attain various 
kinds of contours. Thereafter, the body portion is added to the line drawing to display a motion image of a 
human (Rg. 2). 

The computer graphic apapratus of Rg. 1 includes a basic motion function storage 10 for storing therein 
for each basic motion a periodic function expressing a bending angle of each articulation, a basic motion 
selector 11 for selecting a desired function from the various functions loaded in the storage 10, a joint angle 
computing unit 12 for receiving the function selected from the storage 10 by the selector 11 and for 
computing based thereon a bending angle of the pertinent joint in a time series manner, a speed controller 

13 for controlling a speed at which the computing unit 12 achieves the computation of the joint angle in a 
time series fashion, namely, the speed of a motion conducted by the joint, a multiple-hinged object contour 
storage 15 for storing therein contours used to draw bodies related to lineworks of the various multiple- 
jointed objects, a contour selector 16 for selecting a contour of a multiple-articulated object, a rendering unit 

14 for drawing a body for the motion of the multiple-jointed object, which Is expressed only by joint bending 
angles computed by the computing unit 12, based on the contour read from the storage 15. thereby 
generating image information for displaying the picture in a two-dimensional manner, and a display 17 for 
presenting the picture depending on the image information. 

The basic motion function storage 10 is baded with functions associated witii a motion of each joint for 
each basic action such as a walking action, a running action, or a sitting action. Under this condition, to 
select a basic motion, the operator picks a t>asic operation specification icon 30 presented on the display 
screen as shown in Rg. 2. In the following paragraph, a walking action of a human image is taken as an 
example to be expressed by a function representing a motion to be displayed. 

Rg. 4 is a graph showing curves representing changes with respect to time of measured bending 
angles of primary joints of a walking person viewed from a horizontal direction (X-axis direction). Curves 2a. 
3a. 4a. and 5a designate changes with respect to time of measured bending angles of the coxa, the knee 
joint, the elbow joint, and the shoulder joint, respectively. The angle changes are measured for two periods 
(shides or steps). These curves show correlations existing between the actions of the respective articula- 
tions. Rg. 5 is a spectral diagram obtained by achieving a Fourier analysis on the measure values 3a of the 
knee joint of Rg. 4. Essential spectrum compounds can be expressed by use of a function of at most 
degree 5 or 6. Namely, there need not be employed a complicated expression including high-frequency 
components. In consequence, the change 9^(1) with respect to time of the joint bending angle can be 
expressed by tiie following equation of a quite low degree. For example, as shown in Rg. 5. seven 
spectrum elements need only be required to express the angle change 6^(1). The following function (1) is 
identical with the previously described above, but since the emtwxliment is cleariy described, the function 
(1) is again used as follows; 



®Tn(t) = I^tn + ^ ^mr, • ^In (ll-t + 1^^^ - <1>^ ^ ^ ) 

m m ji-^x ™^ inn m^n 



(1) 



where. 

D^: Direct current component 

Pimn- Amplitude of each frequency component 

^mn: Phase 

m: Joint number 

n: Higher harmonic of n-th order 

*„: Phase difference of 1st order higher harmonic between reference joint and m-th joint (*„, = 0 
for reference joint) 

In tiiis connection, the harmonization between the actions of the respective joints is expressed by use of a 
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difference between phases of the joints. The phase differences are kept retained through the motion. 

The joint angle computing unit 12 of Rg. 1 achieves computations based on the function (1) to obtain 
an action of the knee joint while changing the value of the variable t such that the position of the joint Is 
sequentially displayed at the point of time t, thereby presenting a motion picture of the knee. Incidentally, to 

5 set the action speed, the operator uses a motion specification Icon 33 of Fg. 2. Namely, when tiie display 
item of a vertical bar 40 in tiie icon 33 is horizontally shifted by a mouse cursor or the like, the speed 
controller 13 of Rg. 1 is activated to develop Its operation. The joint angle computing unit 12 computing 
based on ttie function (1) the values of Gm(ti), 0^^), etc. in a time series fashion increases the 

value of t2 - ti = t3 - 12 = ... = At before achieving ttie computations when the operator specifies a higher 

10 motion speed. 

Since tiie function (1) above does not include any parameter denoting a length, even when a size and/or 
a dimensional ratio between joints of tiie object are/is varied, tiie function (1) need not be modified. In 
consequence, also when it is desired to alter a size of a multi-hinged object to be displayed, tfie load 
imposed on ttie operator is not increased; moreover, after the size is changed, tiie animation picture of the 

76 multi-articulated object can be displayed at a high speed. That is. according to the embodiment above, the 
operator need only select a kind of each basic motion, a motion speed thereof, and a contour of each joint 
for a motion picture. Namely, a motion of a multi-jointed object can be developed with a quite small amount 
of information and through a small numt>er of operation steps. 

Refenring now to the motion representing apparatus of Rg. 1. the operation of the first embodiment will 

20 be described. Rrst, the contour storage 15 is loaded, for example, with contour data related to a state of a 
person image standing in an upright style and contour data of a basic posture of a flying butterfly. The 
contour selecting unit 16 selects desired contour data therefrom. For example, when the contour data of a 
person image are selected, the selected data are fed to the rendering unit 14. On the other hand, the basic 
motion function storage 10 is loaded, for example, with functions for which parameters of basic actions of a 

25 person such as a walking action, a running action, and a sitting action are respectively specified. One of ttie 
basic motions Is selected by ttie basic motion selector 11. For example, when a running action is selected, 
the function associated witti tfie running action is transfen^ed to the joint angle computing unit 12, which In 
turn achieves a computation of ttie function (1) to produce data of angles. The computation result is 
transferred together witti a speed change rate indicated by tfie speed conti-oller 13 to the rendering unit 14. 

30 Based on the contour data from ttie contour storage 15 and the angle data thus received, the rendering unit 
14 creates image data to be sent to the display 17, which resultantiy presents tiiereon a picture of ttie 
image data. 

Rg. 6 shows ttie constitution of a computer graphic apparatus in a second embodiment according to ttie 
present invention. As compared with ttie configuration of ttie first embodiment of Rg. 1, the second 

35 embodiment includes a feature component storage 20 and a feature component selector 21. The joint angle 
computing unit 12 Is configured to accomplish computations based on a selected basic operation function 
and a selected feature component. The feature component is here associated with a feature and is used to 
qualify an action or a motion. That Is, the feature component is a feature such as joyfully, sadly, or 
delightfully. In this embodiment, ttie feature components are expressed in ttie form of functions so ttiat the 

40 operator specifies a feature component to be selected. As can be seen from Rg. 2, ttie operator need only 
pick a feature selection icon 31 in ttie screen to choose a characteristic component. For example, witti ttie 
mouse cursor or ttie like arranged over ttie icon 31, each time ttie left-side button Is actuated features such 
as "joyfully", "men-ily", "like a drunkard", and "calmly" are sequentially presented. When a desired feature 
is displayed on ttie screen, ttie operator actuates ttie right-side button to select tiie feature. In a case where 

45 "walk" is selected as the basic motion and "joyfully" is chosen as ttie feature element, ttie object of a 
human image 1 displayed achieves an indicated action, namely, ttie object 1 walks joyfully or merrily. Next, 
a description will be given of a control operation of the characteristic element. 

Rg. 7A is a graph presenting a change witti respect to time of ttie measured bending angle of a knee 
joint in an ordinary walking action, whereas Rg. 7B is a graph showing a change with respect to time of ttie 

so measured bending angle of a knee joint In a joyful walking action (i.e. ttie person walks joyfully). Rg. 8 
shows a result of a spectral analysis achieved on ttie data of ttie joyful walking motion of Rg. 78. In ttiis 
connection, a result of a spectral analysis conducted on the measured values of the ordinary walking action 
of Rg. 7A is presented in ttie graph of Rg. 5. Consequentiy. a difference between ttie spectral analyses 
denotes ttie component associated with ttie feature "joyfully" as shown in Rg. 9. Teh graphs of Rgs. 5. 8 

55 and 9 present only ttie power spectrum components having respectively different phases. As can be seen 
from ttie spectral graph of Rg. 9, tfie primary spectrum representing ttie expression "joyfully" as a feature 
element can be expressed witti a function of at most degree 5 or 6. Wrtfi ttie characteristic "joyfully" taking 
into consideration, the knee bending angle is represented by a function e^W as follows. 
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e„(t) = (D„ + d„) + E l(A„„ + a„„) 
m m in « nun mn 

n=l 



•sin{n-t + (* + rlf^) - ♦™r^.n>l 
mn mn mn»n 

(2) 

where, 

dm: Direct-current compound of "joyfully" 

amn: Component of "joyfully" in each frequency component 

^mn- Phase compoennt of "joyfully" 

When the operator selects "joyfully" as the feature component by means of the selector 21 (Rg. 6). 
values of dm, am. and ^mn are read from the feature component storage 20 to be substituted in the function 
(1), thereby attaining a function (2) to be fed to the computing unit 12. As a result, the system displays on 
the screen an animation picture of a joyfully walking person. 

In accordance with the second emlxxliment. only the feature selection is added to the operations of the 
first emtxxliment so that the multiple-articulated object can conduct an action qualified by the selected 
feature. 

Since the operation of the motion representation apparatus of the second embodiment shown in Fig. 6 
can be understood from the descriptions of the first embodiment of Rg. 1 and the second embodiment 
atiove, a redundant explanation thereof will be here omitted. 

Rg. 10 shows the configuration of a computer graphic apparatus in a third emt>odiment according to the 
present invention. When compared with the second embodiment of Rg. 6, this constitution additionally 
includes a feature controller 22 and a feature magnitude designating unit 23. In this embodiment, the joint 
angle computing unit 12 achieves computations biased on the following function (3). 

0^(T) = (A^ + a^-d^) + • ^ KA^^ + a^-a^^) 
jn m mm ni.^ mn m mn 

- ^ ' n=i ... 

•sin{n-t + + a -ill ) - (|) }] 

mn m ^mn mn*n 

(3) 

where, am and fim denote a magnitude of a feature component and a magnitude or value of an amplitude, 
respectively. In this system, the feature magnitude am is changed to specify motions with expressions in a 
range including, for example, "walk ordinarily", "walk joyfully", and "walk quite joyfully". Altematively, as a 
feature "sadly" opposite to "joyfully", there may be specified motions with expressions such as "quite 
sadly", "ordinarily", and "quite joyfully". In this operation, when ttie display item of the vertical bar 40 is 
horizontally shifted in the Icon 34 denoting the feature magnitude of Rg. 2, the feature magnitude 
designating unit 23 specifies the desired magnitude of the feature component. The amplitude value ^m is 
related to a stride length, which takes the larger value when the indication of the vertical bar 40 approches 
to ttie right end of the icon 32 of Rg. 2. Namely, the multiple-jointed object walks with a larger stride in the 
obtained animation picture. 

According to the third embodiment, only by adding the magnitude specifying operation to the 
operations of the second embodiment, the degree of a feature component and a stride length can be 
altered: moreover, the feature magnitude and the stride length can be changed in a continuous manner. 

Rg. 11 shows the construction of a computer graphic apparatus in a fourth embodiment according to 
the present invention. As compared with the third embodiment in which only one kind of the feature of an 
action can be specified, the user can specify a plurality of features of an action in this emlxxliment. For this 
purpose, there are adopted a feature controller 24 and a feature magnitude designating unit 25. According 
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to the fourth emtwxJiment, a walking action may be accomplished with specifications of. for example, 
"joyfully" and "slowly". In this case, the computations are canied out with the following function (4). It is 
assumed in this function that the value of each parameter can be chartged. 



e (t) = A + Ea .-d .) + B • Z I (A + Za ,-a .) 
' mo • mi mi' m mn . mi mi' 

1 n=l 1 



•sin{n-t + (4^^^ + Za -il; ) - 

mn £ mi mni mn»n 

(4) 



Since a plurality of characteristic components can t»e specified for an action, the objective action is 
conducted with a wider variety of enr>otional expressions. 

As at»ove, according to the fourth emt>odiment, the values of parameters of the function (4) can be 
altered in a successive manner; moreover, the expressions of the action conducted by an image of a person 
can be changed depending on the modified parameters in a realtime manner and through an interactive 
operation. 

In the description of the fourth emtxxliment, the apparatus controls the functions modified for a motion 
of a computer graphic image. However, when a computation result attained from the joint angle computation 
unit 12 is employed as an operational instruction to control an operation of a multiple-articulated robot 
having a real size of the pertinent object, there can be implemented a robot controller operating 
independently of the size of the rotx>t. Furthermore, since the actions to be sent as instructions to the robot 
can be qualified with the features, the robot can perform various kinds of actions with desired functions. 

According to the emkjodiments 1 to 4 described above, since the contour of a multiple-jointed object 
and/or a rot)ot at an intenmediate point of a motion can be computed by use of a function independent of 
the size thereof, multiple-hinged objects and/or robots of various sizes can l>e actuated in a realtime 
manner. In addition, the action can be qualified by a feature of the action; moreover, the degree of the 
feature can be varied. Consequentiy. the motion can be accomplished with quite a large number of 
functions. 

Although a human model has been described in conjunction with the embodiments 1 to 4 above, an 
effect similar to those of the embodiments can naturally be developed also for an object such as a 
measuring worm. 

Referring next to Rg. 12. a description will be given of a computer graphic apparatus in a fifth 
embodiment according to the present invention. The constitution of Rg. 12 includes a data base 51 for 
storing therein functions of time for expressions of motions, a joint angle computing unit 52. a rendering unit 
53. a display 54, and a controller 55. Let us assume here that in order to actuate a person image, a tending 
angle of each joint is varied with respect to time based on the following function. 

1 

6in<t> = + Z {A„-sin(nt + * ) } (5) 

n=i 



This function expressing a joint bending angle with respect to time is obtained from a Fourier series 
expansion of a period function in which a letter m denotes a joint number. To represent a motion of the 
entire human bo6y, there are required a function e^{\) for each of the joints. In the function, i stands for the 
maximum degree of the series expansion, Ao designates a mean value of the bending anglei^ An indicates a 
spectral intensity of an n-th order higher harmonic, and designates a phase of the n-th order higher 
harmonic. 

The data base 51 is loaded, for each kind of motion, with coefficients Ao. Ai A|. ^i , ^2, .... and for 

the function Bmit) of time associated with each joint of a person image. The joint angle computing unit 52 
computes, based on the coefficients Ao, Ai. .... A|, ^1. ^2 and ^1 of an objective motion, a tending 
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angle of each human articulation at a point of time. The rendering unit 53 receives the computated results 
from the joint angle computing unit 52 to further compute based thereon a position and a posture of the 
person Image in a three-dimensional manner so as to project the attained image data onto a two- 
dimensional area. The display 54 presents the resultant picture on its screen. The controller 55 selects 
functions of time from the data base 51, modifies the coefficients Ao. Ai. .... A|, ^2. .... and of each 
selected function of time Omit), and controls a variable t of time. 

As a result, according to the fifth embodiment,' a desired action can be selected, expressions of 
operations other than those stored in the data base 51 can be developed, and the action speed can be 
controlled depending on the variable t of time. 

Rg. 13 shows the configuration of a computer graphic apparatus in a sixth embodiment according to the 
present invention. TTiis system includes a data base 51 for storing therein functions of time for expressions 
of motions, a time function selector 61, storages 62, 63, and 64 for temporarily storing therein the selected 
functions, a mean value computing unit 65 for computing a mean value of functions of time, a joint angle 
computing unit 52, a rendering unit 53, and a display 54. After the function selector 61 choses motions, the 
components of the functions of time representing the motions are stored in the temporary storage 62 
thereof for each motion. Let us assume here that the number of the selected motions is j and the 
amplitudes and phase differences of the respective functions are as follows. Namely. A10. An, An, ^n, 

^12, for motion 1; A20, A2i, ... Az,, ^1, ^2 ^1 for motion 2; and Ajo. Aji, ... Aji, for 

motion j. The amplitudes and phases of the selected functions of time are processed by the function mean 
value computing unit 65. which achieves computations thereon to attain a mean value of each frequency 
component as follows. 

j 

* k=0 

(6) 

3 

j 

E v. 

*n (7) 



Using tiie following function (8), the joint angle computing unit 52 computes, for each angle of the 
person image, a bending angle at a point of time based on the amplitude and tiie phase resultant from the 
functions (6) and (7), respectively. 



®m*<^^ = ^0* ^ ^^n* • sin(nt + II J')} ... (8) 
n=l " " 

The rendering unit 53 processes the data resultant from the computing unit 52 to obtain information in a 
three-dimensional representation of a position and a posture of tiie person image so as to project the 
information onto a two-dimensional space. Based on the projected result, the display 54 presents a person 
image on a screen thereof. 

In short, the system is capable of creating a motion other ttian those loaded in ttie function data base 
51 as follows. Namely, the data base 51 is accessed to obtain therefrom a plurality of functions of time for 
expressions of motions such that the functions are subjected to the computations above, thereby producing 
a desired motion. 

Rg. 14 shows the constitution of a computer graphic apparatus in a seventh emt>odiment according to 
the present invention. This configuration includes a data base 51 for storing ttierein functions of time for 
expressions of motions, a function selector 61. temporary storages 62 to 64 for temporarily storing the 
respective components of the selected functions of time, a unit 71 for computing a weighted mean value of 
the functions of time, a joint angle computing unit 52. a rendering unit 53, a display 54, and a controller 55. 
For the functions of time representing the motions thus selected by the function selector 61. the 
components ttiereof are stored in tfie temporary storage 62 associated therewith for each motion. It is 
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assumed here that the numl)er of the selected motions is j and the amplitudes and phase differences of the 

respective functions are as follows. Tfiat is, Aio. An. ... A,,, ^n. ^„ for motion 1; A20. A2i. ... A21, 

"hu ^2 ^1 for motion 2; and Ap, Aji, ... A|i. ^j2. ^j, for motion j. The amplitudes and phases of 

the selected functions of time are delivered to the function mean value computing unit 65, which achieves 
based thereon computations to attain a mean value of each frequency component as follows. 



n 



k=0 ^ 



(9) 



3 

£ 

_ k=l 



kn 



(10) 



where, ak denotes a weight of a function of time. 

According to the following function (11), the joint angle computing unit 52 computes for each angle of 
the person a bending angle at a point of time by use of the amplitude and the phase attained from the 
functions (9) and (10), respectively. 



®m = ^0 ^ ^^n • sinCnt + ¥^ )} 



(11) 



Thereafter, the rendering unit 53 processes the data resultant from ttie computing unit 52 to attain 
information of a position and a posture of the person image in a three-dimensional manner so as to project 
the information onto a two-dimensional area. Based on the projected result, the display 54 presents a 
human image on a screen thereof. 

As a result of the processing above, the apparatus is capable of generating a motion other than ttiose 
loaded in the function data base 51 as follows. The data base 51 is accessed to obtain therefrom a plurality 
of functions of time for expressions of motions such that based on the functions, ttie computations above 
are executed with the weights for the selected motions taken into consideration, ttiereby producing a 
desired motion. 

Rg. 15 shows the configuration of a computer graphic apparatus in an eighth emt)odiment according to 
the present invention. This system includes a data base 51 for storing therein functions of time for 
expressions of motions, a fransit point specifying unit 81, a moving direction controller 82. a joint angle 
computing unit 52, a rendering unit 53, and a display 54. Fig. 16 shows a relationship between a transit 
point and a moving direction of a multiple-jointed object 1. It is assumed in ttiis diagram ttiat a plane 
defined by tiie x and y axes is a ground surface where a human as the multiple-articulated object 1 stands. 
In this graphic image, the person stands on the ground in a vertical direction i.e. along ttie z-axis. Rrst, ttie 
h-ansit point specifying unit 81 designates a transit point 401 of ttie person in Rg. 16. The moving direction 
controller 82 then rotates ttie object 1 about ttie y axis so ttiat the front side ttiereof faces to ttie transit point 
401. For the displacement of the object 1. ttie user selects expressions of the motion during the movement 
from ttie data base 51. Thereafter, the joint angle computing unit 52 is operated to actuate joints of ttie 
multiple-jointed object 1. Since ttie object 1 is facing to the passage point 401 as a result of the operation 
conducted by ttie moving direction controller 82. ttie object 1 is moved or displaced toward ttie transit point 
401. The rendering unit 53 processes ttie data ft-om ttie computing unit 52 to generate information of a 
position and a posture of ttie object 1 in a ttiree-dimensional manner so as to project the infonnation onto a 
two-dimensional space. Depending on ttie projected result, ttie display 54 presents a picture of ttie multiple- 
articulated object 1 on a screen thereof. 

Witti ttie provision above, ttie system can control ttie moving direction of a human whose motions are 
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represented by the functions of time. 

Fig. 17 shows the constitution of a computer graphic apparatus in a ninth embodiment according to the 
present Invention. This system comprises a data base 51 for storing therein functions of time for 
expressions of motions, a transit point specifying unit 81, a moving direction controller 82, a joint angle 

5 computing unit 52. a rendering unit 53, and a display 54. Rg. 18 shows an example of a display screen 
presenting a relationship between a transit point and a moving direction of a multiple-jointed object 1. Let us 
assume in this diagram that a plane defined by the x and y axes is a ground surface where the multiple- 
articulated object 1. namely, the person stands. In this graphic image, the object 1 takes a stand posture on 
the ground in a vertical direction i.e. along the z-axis of the coordinate system. Rrst, the transit point 

10 specifying unit 81 specifies transit points 601 to 605 of the object 1 on the plane. The specified transit 
points are connected to each other with a curve such as a free curve so as to create a moving route 
designated by a position 601 and a curve 606. The moving direction controller 82 rotates the object 1 about 
the y axis so that the front side thereof is oriented to a direction of a tangent of the curve 606 at a position 
of the object 1 moving on the curve 606. For the displacement of the object 1. the user selects expressions 

15 of the motion during the movement from the data base 51. Based on the selected data, the joint angle 
computing unit 52 actuates joints of the multiple-jointed object 1. Since the object 1 is directed along ttie 
tangent direction at the cunrent passage point on the curve 606 as a result of the operation conducted by 
the moving direction controller 82, the object 1 is displaced along the generated curve 606. The rendering 
unit 53 processes data received from the computing unit 52 to produce infonmation of a position and a 

20 posture of the object 1 in a three-dimensional manner so as to project the information onto a two- 
dimensional space. Based on the projected result, the display 54 presents an image of the object 1 on a 
screen thereof. 

Through ttie operation above, the apparatus can arbitrarily move an image of the human on the plane 
by controlling the functions of time representing expressions of motions of the human. 

25 There may also utilize still another control mettiod of controlling the motions of a multiple-hinged object 
as follows. Namely, ttie user supplies the system, from input means (not shown), with a position 601 
denoting a starting point of a movement of the multiple-articulated object 1, a tangent direction (vector 
information) 607 designating at least one of a speed of the object 1 at the starting point of the movement 
and a direction of the movement of the object 1 thereat, a positin 603 indicating an ending point of the 

30 movement of the object 1 , and vector infonmation (not shown) denoting at least one of a speed of the object 
1 at the ending point of the movement and a direction of the movement of the object 1 thereat. The inputted 
information items are memorized and displayed on the screen. Based on these data items, the system 
accomplishes computations to obtain information denoting a route of the movement of the object 1 from the 
initial position 601 to the terminal position 603. Thereafter, the moving passage portions are similariy 

35 computed between the positions 603 and 604. 604 to 605, and 605 to 606 in a sequential manner. 

Moreover, according to a still anottier motion control mettiod, tiie system is supplied with a position 601 
related to a position of the multiple-jointed object 1 in motion and a tangent direction 607 indicating a 
direction of the movement of the object 1. The inputted information items are then stored in a memory and 
are displayed on a screen. Depending on ttiese data items, tt>e apparatus conducts computations to attain 

40 information designating a path of the movement of the multiple-articulated object 1. In ttiis connection, the 
information item indicating the direction of the moving object 1 is eitfier one of information denoting a 
direction thereof with respect to a desired point in the pertinent coordinate system or to another multiple- 
hinged object, information designating a direction thereof with respect to a desired line in the pertinent 
coordinate system, information indicating a direction thereof with respect to a desired plane in the pertinent 

45 coordinate system, and information denoting a direction thereof with respect to the current direction of the 
movement of the object 1 . 

Rg. 19 shows the construction of a computer graphic apparatus in a tenth embodiment according to the 
present invention. This system comprises a data base 51 for storing ttierein functions of time for 
expressions of motions, a transit point specifying unit 81. a moving route generator 91. a moving direction 

50 controller 82, a controller 101 for adjusting a stride width in a movement along a curve, a function con-ecting 
unit 102. a joint angle computing unit 52. a rendering unit 53, and a display 54. Rg. 20 shows a relationship 
between a stride widtti of a foot of the object 1 on a center side of the radius of curvature and a sti-ide width 
of a foot on a side opposite thereto of the radius of curvature when the object 1 as tiie multiple-jointed 
object moves along a curve 701. Let us assume here that a small interval AL or 702 at a point P or 709 on 

55 the curve 701 where the object 1 is moving has a center of curvature 0 or 703 and a radius of curvature R 
or 704, the distance between ttie foot on ttie center side of the curvature and ttie center of curvature 0 is 
denoted as Ri or by a reference numeral 705, and ttie distance between ttie foot on ttie side opposite to the 
center side of ttie curvature and the center of curvature 0 is denoted as Ro or by a reference numeral 706. 
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The passage route or curve 701 of the object 1 is then produced by the transit point specifying unit 81 and 
the moving route generator 91 of Rg. 19. The moving direction controller 82 adjusts the posture of the 
object 1 such that the front side thereof is oriented along a tangent direction at the point P. The stride 
controller 101 produces, based on the following functions (12) and (13), a stride length Si or 707 on the 
center side of the curvature and astride length S© or 708 on a side opposite thereof when the multiple- 
articulated object 1 moves along the curve. In this connection, a letter S denotes a stride length of the 
object 1 moving along a straight line. 




For a movement of the object 1. the user accesses the data base 51 to acquire therefrom functions for 
desired expressions of motions to be achieved during the movement of the object 1. Resultantly, the joint 
angle computing unit 52 actuates joints of the object 1. The difference between the strides on the inner and 
outer sides is supervised by the stride controller 101 and then the function conrecting unit 102 corrects 
functions of time representing the motions. Since the Image of the object 1 is oriented along a tangent 
direction at the current point of the passage as a result of the operation achieved by tiie moving direction 
controller 82, ttie object 1 moves along the curved line 701 without causing any foot slip on the ground. The 
rendering unit 53 computes, based on the results of the computation of the joint angle computing unit 52, 
information of a position and a posture of the object 1 in the ttiree-dimensional manner so as to project the 
information onto a two-dimensional area. The resultant information is then presented on the display 54. 

With the provisions above, the apparatus can move the human image whose motions are represented 
by functions of time freely on a plane without causing any foot slip on the ground. 

Rg. 21 shows the configuration of a computer graphic apparatus in an 11th emodiment according to the 
present invention. This system comprises a data base 51 for storing tiierein functions of time designating 
expressions of motions, a transit point specifying unit 81, a moving route generator 91. a moving direction 
controller 82, a unit 201 for detecting a radius of curvature, a moving speed detector 202, a centrifugal force 
computing unit 203. a function conrecting unit 102, a joint angle computing unit 52. a rendering unit 53, and 
a display 54. The moving path of a multiple-jointed object e.g. a human is created by the transit point 
specifying unit 81 and the moving path generator 91. The moving direction controller 82 adjusts a posture 
of ttte person image such that the front side thereof is oriented along a tangent direction of a curve of the 
moving path. Rg. 22 shows a relationship between forces applied to a person image when the state of the 
person image is changed from an upright posture with respect to the ground surface to a circular motion. 
This diagram includes a multiple-hinged object 1. a center of curvature 0. a radius of curvature R, a gravity 
force g, a centrifugal force ar, and a resultant force F of the centrifugal force ar and the gravity force g. In 
tills state, the object 1 falls down outwardly due to the centrifugal force ar. More concretely, for the 
observer, the object 1 seems to fall down toward the outside. In this situation, Se poshjre of the object 1 is 
controlled as follows. In the system, a radius of curvature of the curve where the object 1 is just passing is 
sensed by the detector 201 and the current moving speed is detected by the moving speed detector 202. 
Using the radius of curvature and the moving speed, the centrifugal force computing unit 203 achieves 
computations to attain a centrifugal force ar applied to the object 1. Thereafter, in order arrange the person 
posture to be parallel to the resutiant force F of the centrifugal force ar and the gravity g, the function 
con-ecting unit 102 conrects the functions of time representing expressionTof motions to incline the posture 
of the object 1 by an angle 0f.Resultantly, an equilibrium state is established between the centrifugal force 
ar and the gravity force g applied to the multiple-articulated object 1. which hence does not fall down onto 
the ground. Actions of the related joints are then generated by the joint angle computing unit 52. The 
rendering unit 53 computes, depending on the results of the computation of the joint angle computing unit 
52. information of a position and a posture of the object 1 in the three-dimensional manner so as to project 
the information onto a two-dimensional area. The display 54 then presents the obtained information on its 
screen. 
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In short, when moving along a curved line an image of a person whose motions are represented by 
functions of time, the apparatus takes the Influence on the centrifugal force into consideration. Con- 
sequently, there can be prevented an unnatural action in which, for example, the person Image seems to fall 
down onto the ground. 

5 Rg. 24 shows the configuration of a computer graphic apparatus in a 12th embodiment according to the 
present invention. This system comprises a data base 51 for storing therein functions of time representing 
expressions of motions, a transit point specifying unit 81. a moving route generator 91. a moving direction 
controller 82, a unit 201 for detecting a radius of curvature, a moving speed detector 202. a gravity 
correcting unit 301, a centrifugal force computing unit 203. a function conrecting unit 102. a joint angle 

10 computing unit 52. a rendering unit 53, and a display 54. The moving path of a human image is produced 
by the transit point specifying unit 81 and the moving route generator 91. The moving direction controller 82 
arranges a posture of the person image such that the front side thereof is oriented along a tangent direction 
of a curve of the moving path. Thereafter, a radius of curvature of the curve where the object 1 is just 
moving is detected by the detector 201 and the cunrent moving speed is sensed by the moving speed 

15 detector 202. Based on the radius of curvature and the moving speed, the centrifugal force computing unit 
203 achieves computations to attain a centrifugal force ar applied to the person. In order to establish an 
equilibirum state between the centrifugal force ar and thegravity force g applied to the multiple-articulated 
object, the posture of the person image is conrected by means of the function correcting unit 102. The 
gravity conrecting unit 301 is disposed to con-ect the magnitude of Infonmation associated with tfie gravity 

20 force. When information of the gravity Is varied, for example, when the gravity applied to the person Image 
is reduced, the posture thereof is greatly inclined; conversely, when the gravity is increased, the person 
image becomes to be stable, thereby presenting actions of the person image in an arbitrary manner. 
Thereafter, motions of the related joints are then generated by the joint angle computing unit 52. The 
rendering unit 53 computes, based on the results obtained from the joint angle computing unit 52, 

25 infomiation of a position and a posture of the person in the tiiree-dimensional fashion so as to project the 
information onto a two-dimensional space. The display 54 presents the resultant information on its screen. 

In short, when moving along a curve an image of a person whose motions are represented by functions 
of time, the apparatus can alter the magnitude of the gravity applied to the person image such that the 
change in the posture of the person image passing along the curved line Is represented with an emphasized 

30 expression or a moderate expression. 

Fig. 25 shows the construction of a computer graphic apparatus in a 13th embodiment according to the 
present invention. This constitution includes a data base 51 for storing therein functions of time respresen- 
ting expressions of motions, a position specifying unit. 501, a distance computing unit 502. a stride 
information Input device 503. a stride controller 504. a function correcting unit 102. a joint angle computing 

35 unit 52, a rendering unit 53, and a display 54. Rg. 26 shows a display example of a relationship between a 
moving route and a stride of a person image. This diagram includes a curved line 1001 denoting a moving 
route of ttie person image. The position specifying unit 501 is employed to specify two points xi and X2 on 
tiie curve 1001 and ttien the distance computing unit 502 determines a distance L of a portion xiX2 of the 
curve 1001. The stride input device 503 is disposed to Input therefrom a stride count n required when the 

40 person image moves along the curve 1001 from fhe point xi to the point X2. The stride controller 504 
obtains ttie stride length S based on the following equation to send the value S to the function con-ecting 
unit 102. 

S = k (14) 

45 

The function correcting unit 102 corrests functions of time chosen from the data base 51 such that the 
stiride width becomes to be S. Using the conrected functions of time, the joint angle computing unit 52 
generates actions of the respective joints. Based on the computation results, the rendering unit 53 attains 
50 information of a position and a posture of the person image in tfie ttiree-dimension fashion. The infomiation 
Is then projected onto a two-dimensional space to be presented on a screen by the display 54. 

In summary, the apparatus can move an image of a person along a preset interval on a curve with a 
predetermined number of strides. 

Rg. 27 shows tfie configuration of a computer graphic apparatus in a 14th embodiment according to the 
55 present invention. This structure comprises a data base 51 for storing therein functions of time representing 
expressions of motions, a time specifying unit 511. a time computing unit 512. a stride count input device 
503. a controller 514 for supervising a period of time required for a sti-ide or step, a function correcting unit 
102, a joint angle computing unit 52. a rendering unit 53. and a display 54. Rg. 28 shows a display example 
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of the display 54 representing a relationship of a stride with respect to time (on a horizontal line or an 
abscissa) in a movement of the person image. TTie time specifying unit 51 1 Is employed to specify two 
points of time ti and t2 on the line 1101 designating elapsed time. The time computing unit 512 obtains an 
interval of time between the points of time ti and tz on the line 1101. TTie stride count input device 503 is 
5 disposed to input therefrom a stride count n required when the person moves during the interval of time 
from ti to tz- The stride period controller 514 obtains the period of Ts required for a step t)ased on the 
following equation, thereby sending fhe attained value Ts to the function correcting unit 102. 

Ts = ; (15) 

10 

The function correcting unit 102 achieves a correction on functions of time chosen from the data base 
51 such that the stride period becomes to be Ts. Depending on the corrected functions of time, the joint 
angle computing unit 52 generates motions of the respective joints. On receiving the computation results, 

76 the rendering unit 53 computes based thereon information of a position and a posture of the person in the 
three-dimensional fashion. TTie information is then projected onto a two-dimensional space so as to t)e 
presented on a screen by the display 54. 

As a result, the system can move an image of a person along a line during a preset interval of time with 
a predetermined number of steps. 

20 Rg. 29 shows the constition of a computer graphic apparatus in a 15th embodiment according to the 
present invention. This structure comprises a data base 51 for storing therein functions of time representing 
expressions of motions, a posture specifying unit 522, a position specifying unit 521, a function correcting 
unit 102. a joint angle computing unit 52, a rendering unit 53, and a display 54. The posture specifying unit 
522 is adopted to designate a desired posture (in a stationary state) of a person image. The position 

25 specifying unit 521 is used to denote a position in the space where the human takes the posture. In this 
situation, the person image is moving with motions associated with functions of time selected from the data 
base 51. When tiie person image approaches the position specified by the position specifying unit 521, in 
order to develop the posture denoted by the posture specifying unit 522. the function conrecting unit 102 
conrects the functions of time. At the specified position, the person image takes the denoted posture. 

30 Depending on the corrected functions of time, the joint angle computing unit 52 creates motions of the 
respective joints. Based on the computation results, the rendering unit 53 obtains infomnation of a position 
and a posture of the person Image in the three-dimensional fashion. The infonmation is then mapped onto a 
: ^ two-dimensional area to be presented on a screen by the display 54. . . 

Resultantty. the constitution can present an image of a multiple-articulated object in a specified posture 

35 at a predetermined position while the object is acting based on functions of time. 

Rg. 30 shows the construction of a computer graphic apparatus in a iett> embodiment according to the 
present invention. This structure comprises a data base 51 for storing therein functions of time representing 
expressions of motions, a posture specifying unit 522. a time specifying unit 531. a function correcting unit 
102. a joint angle computing unit 52, a rendering unit 53, and a display 54. The posture specifying unit 522 

40 is adopted to designate a desired posture (in a stationary state) of a person image. The time specifying unit 
531 is used to denote a point of time when the person image takes the posture. The person image is 
moving with motions presented by functions of tinte selected from the data tiase 51. At a point of time in 
the vicinity of the point of time specified by the time specifying unit 531 . in order to develop the posture 
designated by the posture specifying unit 522, the function conrecting unit 102 corrects the functions of 

45 time. At the specified point of time, tiie person image takes the denoted posture. Using the corrected 
functions of time, the joint angle computing unit 52 creates motions of the respective joints. Based on the 
computation results, the rendering unit 53 obtains information of a position and a posture of the person 
image in the three-dimensional fashion, which is then projected onto a two-dimensional area to be displayed 
on a screen by the display 54. 

50 With the operations above, the system can present an image of a multiple-articulated object in a 
specified posture at a predetemnined point of time while the object is moving based on functions of time. 

Rg. 31 shows the configuration of a computer graphic apparatus in a 17th embodiment according to the 
present invention. This constitution comprises a data base 51 for storing therein functions of time 
representing expressions of motions, a function selector (A) 542. a position and functin storage (A) 545, a 

65 position specifying unit (B) 543, a function selector (B) 544, a position and function storage (B) 546. a 
distance computing unit 547, a function interpolating unit 548. a joint angle computing unit 52. a rendering 
unit 53. and a display 54. Rg. 32 show a screen display example of the display 54 useful to explain a 
mettiod of interpolating expressions of motions of a person image while the person image is moving. The 
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person image moves from a left-hand side to the right-hand side along a straight line 1401. The position 
specifying unit (A) 541 is employed to specify a point Xm or 1402 on the straight line 1401 and then the 
function selector (A) 542 Is Initiated to select from the data base 51 functions of time related to an 
expression of the motion at the point 1402. Let us assume here, that "the person walks in an ordinary 

5 manner" has been selected (1403 in Rg. 32) and that each frequency component of the function of time 
has a spectral intensity A^n and a phase ^mn- The position X„, on the straight line 1401 and the spectral 
intensity A^n and the phase ^mn of the function of time representing the action are loaded in the position 
and function storage (A) 546. Next, the position specifying unit (B) 543 is used to specify a point X^+i or 
1404 and then the function selector (B) 544 selects from the data base 51 functions of time related to an 

10 expression of the motion at the point 1404. It is assumed here that "the person walks cheerfully" has t>een 
seelcted (1405 in Rg. 32) and that each frequency component of the function of time has a spectral 
intensity A^+in and a phase ^m+m- The specified position X^+i on the straight line 1401 and the spectral 
intensity A^+in and the phase ^m+m of the function of time representing the motion are stored in the 
position and function storage (B) 546. The distance computing unit 547 is adopted to determine a current 

75 position of the person image. Let us assume here that the current position is denoted as x or by a reference 
numeral 1406. The function interpoatting unit 548 processes the functions of time relate to the two points 
and the current position to obtain a spectral intensity A„(x) and a phase ^n(x) of the function of time at the 
present position x based on the following equations. 
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A„(x) = A„„ + V^" " (X - X„) (16) 



*n<*> = ^mn + V^" " I"" (x - X„) (17) 

" °" ^m+1 " 



Using the spectral intensity A„(x) and a phase <f,„{x) of the function of time determined from the 
equations (16).and'(17)..the joint angle computing unit 52 solves the following function to ettain ihe joint 
angles. 



®n<t) = A^t'f) + ^ {A„(x) •sin(nt + * (x) ) } 
n o , n n 



(18) 



Based on interporated functions of time, the joint angle computing unit 52 creates motions of the 
respective joints. In this example, there is produced an intenmediate action 1403 between the ordinary walk 

45 and the cheerful walk. Based on the computation results, the rendering unit 53 generates information of a 
position and a posture of the person Image in the three-dimensional fashion. The information is then 
projected onto a two-dimensional space, which is then presented on a screen by the display 54. 

As a result, the system can present an Image of a multiple-articulated object in which the image moves 
with an expression developed by an interpolation of motions between two specified positions. 

50 Rg. 33 shows the configuration of a computer graphic apparatus in an 18tti emlxxJiment according to 
the present Invention. This structure includes a data base 51 for storing therein functions of time 
representing expressions of motions, a time specifying unit (A) 551. a function selector (A) 552, a time and 
function storage (A) 555, a time specifying unit (B) 553, a time and function selector (B) 554. a time and 
function storage (B) 556. a time computing unit 557, a hjnction interpolating unit 548, a joint angle 

55 computing unit 52, a rendering unit 53, and a display 54. Rg. 34 shows a screen display example produced 
by the display 54 for explaining a method of interpolating expressions of motions of a person image being 
displaced. In this diagram, a straight line 1501 stands for an axis of time. The time specifying unit (A) 551 is 
used to specify a point of time T^ or 1502 on the time axis 1501 and then the function selector (A) 552 
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selects from the data base 51 functions of time associated with an expression of the motion at the point of 
time 1502. Let us assume here, that "the person walks in an ordinary manner" has been selected (1503 in 
Rg. 34) and that each frequency component of the function of time has a spectral intensity A^n and a phase 
^TO>- "Hie point of time specified on the time axis 1501 and the spectral intensity A„,n and the phase 
of the function of time representing the action are memorized in the time and function storage (A) 555. 
Subsequently, the time specifying unit (B) 553 is adopted to specify a point of time T^+i or 1504 and then 
the function selector (B) 554 selects from the data base 51 functions of time related to an expression of the 
motion at the point of time 1504. Let us assume here that a motion "the person walks cheerfully" has been 
chosen (1505 in Rg. 34) and that each frequency component of the function of time has a specfral intensity 
Am +1 and a phase ^m+m- The specified position T^+i on the time axis 1501 and the specfral intensity 
Am+in and the phase ^m+in of the function of time representing the motion are memorized in the time and 
function storage (B) 556. The time computing unit 577 is then activated to determine a current point of time, 
which is assumed here to be denoted as t or by a reference numeral 1506. The function interpolating unit 
558 processes the functions of time associated with the two points and the cunrent point of time to attain a 
specfral intensity A„(t) and a phase ^„(t) of ttie function of time at ttie present point of time t based on ttie 
following equations. 





~ ^mn 




- T 
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m+ln 
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mn 


"^m+l 


m 



Using tiie specfral intensity A„(t) and ttie phase ^„(t) of ttie function of time determined from ttie 
equations (16) and (17). the joint angle computing unit 52 solves ttie following function to obtain the joint 
angles. 



e„(t) = A^(t) + E {A„(t) • sin(nt + H-^Ct))} 

(21) 



Based on the functions of time determined through the interpolation, the joint angle computing unit 52 
produces actions of ttie respective joints. In this example, there is generated an intermediate action 1503 
between ttie ordinary walk and ttie cheerfrjl walk. Depending on ttie computation results, ttie rendering unit 
53 generates information of a position and a posture of ttie person image in the ttiree-dimensional fashion, 
which is ttien projected orto a two-dimensional space to be displayed on a screen by the display 54. 

Witti the provision above, ttie apparatus can present an image of a multiple-articulated object in which 
ttie image moves with an interpolated expression developed by an interpolation of motions between two 
specified positions. 

Rg. 35 shows the structure of a computer graphic apparatus in a 19tti embodiment according to ttie 
present invention. This configuration includes a data base 51 for storing ttierein functions of time 
representing expressions of motions, an angle specifying unit 561 . a function expression separator 562, a 
key-frame motion generator 563. a motion combining unit 564, a joint angle computing unit 52, a rendering 
unit 53, and a display 54. In some cases, all actions of a person image cannot be represented by use of 
functions of time stored in ttie data base 51. For example, in a case where a motion "a waling person waves 
his or her hand" is desired to be produced, even when an action "a person walks" is already loaded in ttie 
data base 51. if a motion off "wave a hand" is missing therein, ttie desired action cannot be obtained. Next, 
a description will be given of a method of generating a motion, for example, "a walking person waves his or 
her hand" in tfie computer graphic apparatus of ttie 19tti embodiment. Rrst. functions of time representing 
an action "walk" are selected from ttie data base 51. Let us assume here ttiat ttie person image waves ttie 
left hand. In ttiis situation, ttie joints ranging from ttie left shoulder joint to the joint of ttie tip of ttie hand are 
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required to be separated from those to be represented wrth the functions of time above. This operation is 
accomplished by the joint specifying unit 561. The function expression separator 562 accordingly separates 
the specified joints from the function expression. Actions of the remaining joints are then generated by the 
joint angle computing unit 52. For the spearated joints, motions are produced by the key-frame motion 
generator 563 creating motions in the key frame method. The motion combining unit 564 combines the 
motions generated in the key frame method with those prepared depending on the functions of time. Using 
the combined results, the rendering unit 53 generates information of a position and a posture of the person 
image in the three-dimensional fashion. The infonmation is then projected onto a two-dimensional space to 
be presented on a screen by the display 54. 

As a result, the apparatus can present an image of a multiple-articulated object in which the image 
conducts an action not registered to the data t>ase in advance. 

Rg. 36 shows the construction of a computer graphic apparatus in a 20th embodiment according to the 
present invention. This constitution comprises a data base 51 for storing therein functions of time 
representing expressions of motions, an angle specifying unit 561. a function expression separator 562. a 
key-frame motion generator 563, a function transfonmer 571. a motion combining unit 564, a joint angle 
computing unit 52, a rendering unit 53, and a display 54. The structure of this embodiment is implemented 
by additionally disposing a function transformer 571 preceding to the key-frame motion generator 563 of the 
apparatus of the 19tti embodiment shown in Rg. 35. An action generated by the key-frame motion 
generator 563 is transformed by the function transformer 571 into a function of time such as one 
represented by the function (5). The motion represented by the transformed result is registered to the data 
base 51 so as to be used again in another processing later. 

In short, according to the 20th embodiment, a motion which has not been registered to the data base is 
generated in the key frame method and Is then transformed into a function of time, which is registered to 
the data base so as to be employed again in an operation later. 

Rg. 37 shows an apparatus for creating a function of time representing an action. The constitution 
includes a motion measuring unit 581, a function transfonmer 582, and a data base 51 storing functions of 
time for expressions of motions. Rg. 38 shows an example of a procedure used to create a function of time 
representing an expression of a motion. Rrst, the motion measuring unit 581 measures an action (angle) of 
each joint of a person image as a multiple-articulated object 1. In the example of Rg. 38, a video camera 
1802 is adopted to shoot an image of the object 1 in motion such that based on an image 1803 presented 
on a screen for each frame, the motion of each articulation is measured, which is obtained, for example, as 
shown in a graph 1804. The function transfonmer 582 then accomplishes a Fourier series expansion on the 
measured, data to obtain s function (representing an expression of a motion) similar to the function (5), The 
resuitant function of time is then loaded in the data base 51. 

Through the operation above, the apparatus can process an actual action of a person image to create a 
function of time representing an expression of the action. 

Rg. 39 shows an apparatus for generating a function of time representing an expression of a motion. 
The configuration includes a motion measuring unit 581, a measured data conrecting unit 591, a function 
transfomner 582, and a data base 51 for storing therein functions of time for expressions of motions. This 
system is materialized by adding the measured data correcting unit 591 to the apparatus of Rg. 37. The 
measured data has a difference with respect to actual data t)ecause of a measuring error and an 
inappropriate measurement. In order to minimize the discrepancy therebetween, the measured data 
correcting unit 591 accomplishes a filtering operation and a conrection on the measured data. 

As a result of these operations, according to the apparatus of Rg. 39, when an actual motion of a 
person image is measured, any enror appearing in the measuring operation can be removed to appropriately 
create a function of time representing an expression of the motion. 

Rg. 40 shows a structure of an alternative apparatus for generating a function of time representing an 
expression of a motion. The configuration includes a key-frame motion generator 801 . a function transfonner 
582, and a data base 51 storing functions of time for expressions of motions. In this system, a motion of a 
person image is first generated by the motion generator 801 in the key frame method. The generated 
motion (a change with respect to time in the bending angle of each joint) is transformed into a function of 
time representing the motion, which is then registered to the data base 51 . 

As a result, the apparatus can produce, based on the motion prepared according to the key frame 
method, a function of time representing an expression of the motion. 

Rg. 41 shows the constitution of a still another apparatus for creating a function of time representing an 
expression of a motion. The configuration includes a data base 51 loaded with functions of time for 
expressions of motions and a function correcting unit 811. In this system, the function correcting unit 811 Is 
disposed to modify a function of time representing the motion selected from the data base 51. The 
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mcxirfying operation here includes a filtering operation of a function representing an action, an interpolation 
on a motion function, and an operation to otrtain a mean value of a plurality of motion functions. The 
modified functions are stored in the data base 51 so as to be used again in an operation later. 

With this provision, the apparatus of Rg. 41 modifies a function of time representing the motion 
5 selected from the data base 51 and then stores the modified function In the data base, thereby enabling the 
resultant function to be employed again later. 

Rg. 42 shows a constitution of a computer graphic apparatus in a 21st embodiment according to the 
present invention. The structure of this embodiment includes a data base 51 storing functions of time for 
expressions of motions, a function selector 821 for selecting a function of time for a joint constituting a body 
10 of a multiple-articulated object, a temporary storages 822 to 824 for temporarily storing therein selected 
functions of time for the associated joints, a function composing unit 825. a joint angle computing unit 52. a 
rendering unit 53. and a display 54. The system of this embodiment is adopted to present an action of a 
person image as a multiple-hinged object in which the upper-half body of the person image conducts a 
walking action and the lower-half body thereof achieves a running action. In this example, the system 
75 accomplishes operations as follows. The function selector 821 selects from the data base 51 functions of 
time for the walking action of the upper-haH of the body, which are stored in the temporary storage 822. 
Subsequentiy, the function selector 821 similarly selects functions of time for the running action of the 
lower-half of the body, which are stored in the temporary storage 823. The function composing unit 825 
then combines the functions of the upper-hatf of the body with those of the lower-half thereof. Based on the 
20 resultant function of time, the joint angle computing unit 52 achieves computations to determine actions of 
the respective joints. The rendering unit 53 processes the resultant data to obtain a position and a posture 
of the person image in the three-dimensional fashion. Infonmation of the position and the posture is then 
projected onto a two-dimensional space so as to be displayed on a screen off the display 54. 

Resultantly, according to the 21st embodiment, a function of time can be selected for each articulation 
25 of the person image such that actions of the respective joints are combined with each other to achieve a 
motion of the person image. 

Rg. 43 shows a motion editor 305 available as an editing section of the configurations of Rgs. 12 to 42. 
The motion editor 305 is adopted to input various parameters and the like of the respective emobiment. for 
example, from a screen. The configuration of the editor 305 includes a motion expression specifying part 
30 951, a path and speed specifying part 952. and a key-frame motion correcting part 953. 

In the screen example of Rg. 44. the motion expression specifying part 951 is used, for example, to 
select a function representing an expression of a motion in the embodiments atiove and to adjust weights 
applied to the selected functions. The, motion. expression specifying part 951 outputs a function (related to a 
spectral intensity and a phase angle for a motion of each joint) representing a motion desired by the user. 
35 Rg. 45 shows a screen display example of the path and speed specifying part 952 in which a moving 
patii. a moving speed, and an expression of a motion is specified for an image of a person in the 
embodiments above. This part 952 produces data indicating a bending angle of each joint of the person 
image for each frame of the picture. 

In a screen example of the key-frame motion conrecting part 953 of Rg. 46, a portion of an expression 
40 of a motion represented by functions of time is separated from the function expressing so as to be 
generated according to the key frame method. 

In the embodiments descritjed above, description has been given of examples in which a computer 
graphic system is adopted to represent an image of a person so as to control an action of the person 
image. However, the results obtained from the joint angle computing unit 12 may be used as instmctions for 
45 actions, namely, action control signals of a multiple-articulated robot having a real size of the associated 
object, thereby implementing a robot control system driving the rotiot. 

A description will now be given of such an example. Rg. 47 shows the constitution of an apapratus 
controlling a robot in a 22nd embodiment according to the present invention. As compared with the control 
apparatus of Rg. 1. tiie object contour storage 15 is dispensed with. Namely, the contour storage 15 is 
50 replaced with a robot 2000 shown in Rg. 48; moreover, the rendering unit 14 is substituted for actuators A. 
Each actuator A is disposed to bend an associated joint of the robot 2000 depending on a joint bending 
angle computed by the joint angle computing unit 12. In consequence, like in the case of the embodiments, 
the respective articulations are actuated in a hannonized manner t»ased on a basic function for an action 
such as "walk" or "mn" selected by the basic motion selector 11. Moreover, as already described in 
55 conjunction with the embodiments, when the basic motion function storage 10 is supplied with, in addition to 
the actions such as "walk" and "run", feature components, for example, a characteristic element represent- 
ing an emotional expression of a person, the robot 2000 can be actuated in a motion such as "walk menily" 
or "run sadly". 
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Also, the following items are added to the above description. 

1. A method of representing a motion of a multiple-jointed object (1) in which an action of each 
articulation (3. 4. 5) of the object is controlled so as to present the motion thereof on a screen (17), 
comprising a step (Rg. 2) of: specifying by an operator a feature component qualifying a motion, thereby 
actuating the object in a motion associated with the feature component. 

2. A method of representing a motion of a multiple-jointed object (1) in which an action of each 
articulation (3, 4, 5) of the object is controlled so as to present the motion thereof on a screen (17), 
comprising the steps of: 

attaining a bending angle of each said joint as tiie following function $^{{) independent of a length 
between joints of the object; and 



= D_ + Z A ^ • sin(n-t + * - (J) ) 
m m mn mn ^m*n 

n=i 

(1) 



Ofni Direct current component 

An,n: Amplitude of each frequency component 

^mn: Phase 

m: Joint number 

n: Higher harmonics of order n 

Phase difference of 1st order higher harmonics between reference joint and m-th joint (^^ 

= 0 for reference joint) 

obtaining, from a value of the function ejf), data of a contour of the object in motion, thereby 
displaying the contour data. 

3. A method according to No. 2 furttier including a step of changing a value of at least either one of the 
parameters A^n, and of ti^© function (1). thereby varying the motion of the multiple-articulated 
object acting based on the function (1). 

4. A method according to No. 3. further Including the following steps of (Rg. 10): 

establishing a con^espondence between a variation width of the value of the parameter and the 
feature component qualifying the motion; and 

specifying by the operator ttie feature, component in place of the variation widti), thereby changing 
the motion. 

5. A method according to No. 4 further including a step (Rg. 10) of changing a magnitude for the 
variation width based on the feature component. 

6. A computer graphic apparatus for presenting a motion of a multiple-hinged object (1) on a screen (17) 
in which an action of each joint (3, 4, 5) of the object is controlled so as to present the motion thereof on 
the screen comprising: 

means (30-34) for specifying by an operator a feature component qualifying a motion; and 
means (22, 12, 14, 17) for actuating the object being displayed to conduct a motion associated with 
the specrtied feature component. 

7. A computer graphic apparatus for presenting a motion of a multiple-hinged object (1) on a screen (17) 
in which an action of each joint (3, 4, 5) of the object is controlled so as to present the motion thereof on 
the screen, comprising: 

store means (10) for storing therein the following function 0rn(t) representing a bending angle of each 
said joint and; 



Qm^^) = + ^ ^mn ' Sin(n-t + - <I>^.^) 

m ^ , mn mn m*n 

n— i 



(1) 



Dm. Direct current component 

Amn: Amplitude of each frequency component 

^mn: Phase 
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m: Joint number 

n: Higher harmonics of order n 

<ttm- Phase difference of 1st order higher harmonics between reference joint and m-th joint {<t>m 
= 0 for reference joint) 

means (14, 17) for computing a value of the function $m{t) for each said joint and for obtaining 
therefrom data of a contour of the object in motion, thereby displaying the contour data on the screen. 
8. A computer graphic apparatus for presenting a motion of a multiple-hinged object (1) on a screen (17) 
in which an action of each joint (3, 4, 5) of the object is controlled so as to present the motion thereof on 
the screen, comprising: 

store means (10) for storing therein the following function flm(t) representing a bending angle of each 
said joint; and 

m m . ^ mil mn 

n=x 

•sin{n-t + + H)) - 

mn mn mn *n 

(2) 



D^: Direct current component 

Amn- Amplitude of each frequency component 

^mn' Phase 

m: Joint numt)er 

n: Higher harmonics of order n 

^m: Phase difference of 1st order harmonics between reference joint and m-th joint (^m = 0 for 
reference joint) 

dm: Direct current component of qualification component 

a^n: Qualification component of each frequency component 

^mn^ Phase component of qualification component 



means (20) for setting and for changing values .of d^, amn. .and ^mn; and 

means (14. 17) for computing a value of the function 0^(0 for each said joint and for obtaining 
therefrom data of a contour of the object in motion, thereby displaying the contour data on the screen. 

9. An apparatus according to No. 8 further Including: 

a table (20) for storing therein preset/change values respectively of dm. a^n. and ^mn and feature 
components as words qualifying the motion of each said joint with conrespondences established 
therebetween; and 

means (21, 22) for referencing said table, in response to a word specified by an operator as a 
feature component, thereby determining the preset/change values of dm. amn. and ^mn- 

10. A computer graphic apparatus for presenting a motion of a multiple-hinged object (1) on a screen 
(17) in which an action of each joint (3, 4, 5) of the object Is controlled so as to present the motion 
thereof on ttie screen, comprising: 

store means (10) for storing therein the following function 0m(t) representing a bending angle of each 
said joint; and 

m m mm ni _ , mn m mn 

n==i 

•sin{n*t + + a -Tp ) - 6 •n}] 

mn m ^mn' ^mn 

(3) 
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n - 


Direct current component 


A 

"mn- 


Amplitude of each frequency component 




rnase 


m: 


Joint number 


n; 


Higher harmonics of order n 




Phase difference of 1st order higher harmonics between reference joint and m-th joint 




(*m = 0 for reference joint) 


dm: 


Direct cunrent component of qualification component 




Qualification component of each frequency component 




Phase component of qualification component 




Magnitude 



means (23) for setting and for changing values of a^, and fiml and 

means (14, 17) for computing a value of the function emit) for each said joint and for obtaining 
therefrom data of a contour of the object in motion, thereby displaying the contour data on the screen. 
11. A computer graphic apparatus for presenting a motion of a multiple-hinged object (1) on a screen 
(17) in which an action of each joint (3, 4, 5) of ttie object is controlled so as to present the motion 
thereof on the screen, comprising: 

store means (10) for storing therein the following function 5m(t) representing a bending angle of each 
said joint; 

e (t) = (D + Ea . -d . ) + B • L [ (A + Zci -a .) 
' * m .mi mi' "^m ^ ^ ^ mn ."tai mni' 

•sin{n-t + + La .-li; . ) - <b -n}] 

* mn ^ mi ^mni' ^mn ^ 

(4) 



D^: Direct current component 

Amn: Amplitude of each frequency component 

^mn:- Phase . 

m: Joint numt)er 

n: Higher harmonics of order n 

<l>m- Phase difference of 1st order higher harmonics between reference joint and m-th joint (^, 

= 0 for reference joint) 

dmi: Direct cunrent component of each qualification component of different kind 

a^ni: Different kind of qualification component of each frequency component 

^nwh Phase component of each qualification component of different kind 

am\: Magnitude of each qualification component 

0m' Magnitude of amplitude 



means (23) for setting and for changing values of magnitudes a„i and fimu 
means (21) for setting and for changing values of d^,, a^nh and ^„,ni; 

means (12, 14. 17) for computing a value of tiie function $^(1) for each said joint and for obtaining 
data of a contour of the object in motion, thereby displaying the contour data on the screen. 

1 2. An apparatus according to No. 1 1 further including: 

a table (20) for storing therein preset and change values of dmi, a^nu and ^m„, (i varies for each kind 
of feature component) and the feature component as a word qualifying a motion of the action of each 
said joint in motion with conrespondences established therebetween; and 

means (21. 22) for referencing said table depending on at least a word specified by an operator as a 
word, thereby determining the values of d^t. amni. and ^mni- 

13. An apparatus for representing a motion comprising: 

store means (51) for storing therein a plurality of primary functions of time designating actions of 
respective joints (3, 4. 5) of a multiple-jointed object (1); 

select means (61) for selecting, from the plural primary functions of time, a plurality of primary 
functions of time; 

computation means (65) for achieving, based on the selected primary functions of time, a computa- 
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tion of at least a secondary function of time; and 

output means (53) for outputling, based on the secondary function of time, a motion of the multiple- 
jointed object. 

14. An apparatus according to No. 13 wherein said computation means achieves the computation of at 
least a secondary function of time based on a mean value of the selected plural primary functions of 
time. 

15. An apparatus according to No. 14 wherein tiie means value is obtained by applying magnitude to the 
respective primary functions of time. 

16. An apparatus according to No. 13. 14, or 15 wherein said output means is display means. 

17. An apparatus for representing a motion a multiple-jointed object (1) in which a route of the movement 
of the object is created comprising: 

input means (81) for Inputting ttierefrom infonmation designating a first position of the movement of 
the object, information denoting at least either one of a speed of the object and a direction of the 
movement thereof at the first point, information indicating a last position of the movement of the object, 
and information denoting at least eitfier one of a speed of the object and a direction of the movement 
ttiereof at the last point and 

computation means (82) for achieving computations, based on the four kinds of information, to attain 
information designating a patii of the movement of the object from the first position to the last position. 

18. An apparatus according to Claim 17 furttier including display means (54) for displaying ttie 
infomnation designating a path of the movement of the object from the first position to ttie last position. 

19. An apparatus according to No. 18 wherein said display means displays the infonmation designating a 
first position of the movement of the object and the information indicating a last position of the 
movement of the object. 

20. An apparatus according to No. 18 wherein said display means displays the infonmation denoting at 
least either one of a speed of the object and a direction of ttie movement thereof at the first point and 
the information denoting at least either one of a speed of the object and a direction of the movement 
thereof at the last point. 

21. An apparatus according to No. 17 wherein tiie information denoting at least either one of a speed of 
the object and a direction of the movement ttiereof at the first point and ttie information denoting at least 
eitiier one of a speed of the object and a direction of the movement thereof at ttie last point are vector 
information. 

22. An apparatus for representing a motion of a multiple-jointed object in which a route of a movement of 
the object is created comprising: 

input means (81) for inputting therefrom Information associated with a position of the object in ttie 
movement and information designating a direction of the movement of the object; and 

computation means (91) for achieving computations, based on the Information associated with a 
position of the object in the movement and the information indicating a direction of the movement of the 
object, to attain infonmation designating a patti of the movement of the object being moved. 

23. An apparatus according to No. 22 furttier including store means (82) for storing ttierein ttie 
infonmation associated with a position of the object in the movement and the Infonmation of a direction of 
the movement of the object. 

24. An apparatus according to No. 22 wherein the information denoting a direction (607) of ttie 
movement of ttie object is infonmation indicating a direction of ttie object in the movement relative to a 
desired point (601) in a coordiante system or to another multiple-jointed object. 

25. An apparatus according to No. 22 wherein ttie information denoting a direction of the movement of 
the object is information indicating a direction of the object in the movement relative to a desired line 
(606) in a coordinate system. 

26. An apparatus according to No. 22 wherein ttie infonnation denoting a direction of ttie movement of 
ttie object is infonmation indicating a direction of ttie object in the movement relative to a desired plane in 
a coordinate system. 

27. An apparatus according to No. 22 wherein tfie infonmation denoting a direction of the movement of 
the object is infonmation indicating a direction of the object in the movement relative to a preceding 
direction of the movement of the object. 

28. A motion representing apparatus for representing with functions of time an action of each joint (3. 4, 
5) of a multiple-jointed object (1 ) comprising: 

means (81) for specifying ti'ansit points of the object; 

patti generate means (91) for generating a patti along which ttie object moves between specified 
h'ansit points; and 
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output means (53, 54, 82) for outputting a motion of the object passing a specrfied transit point. 

29. A motion representing apparatus for representing witfi functions of time an action of each joint (3. 4. 
5) of a multiple-jointed object (1) comprising: 

means (81) for specifying transit points of the object; 

path generate means (91) for generating a path along which the object moves between specified 
transit points; and 

output means (53. 54, 82) for outputting a motion of the object passing a point in the proximity of a 
specified transit point. 

30. An apparatus according to No. 28 or 29 further including means (82) for drawing a curved line 
between the specified transit points (603-605) and for allowing the object to move along the curved line 
between the specified transit points. 

31. An apparatus according to No. 28 or 29 further including: 

means (82) for drawing a curved line between the specified transit points to allow the object to move 
along the curved line between the specified transit points; 

means (101) operative, when the object moves along the generated curved line, for minimizing a 
stride width (Si) of a foot of the object on a side of a radius of curvature and for increasing a stride width 
(So) of a foot thereof on a side opposite thereto of a radius of curvature depending on a radius of 
curvature of the curved line where the object Is moving; and 

means (102) for preventing each said foot from slipping on a tangential plane of the curved line, 
thereby controlling the object to move along the curved line without causing any foot slip. 

32. A motion representing apparatus for representing with fucntions of time an action of each joint (3, 4, 
5) of a multiple-jointed object (1) comprising: 

means (291) operative, when the object moves along a curve, for detecting or computing a radius of 
curvature of the curve; 

means (202) for detecting or computing a speed of the movement of the object; 

means (203) for computing a centrifugal force based on ttie radius of curvature and the speed; and 

means (102) for con-ecting the hjnctions of time, thereby establishing an equilibrium state between 
ttie centrifugal force (ar) and a gravity (g) applied onto the object. 

33. An apparatus according to No. 32 furttier including means (301) for altering information related to the 
gravity. 

34. A motion representing apparatus comprising: 

means (501) for specifying a plurality of points in a space; 
means (503) for inputting therefrom information related to a nunsl-^er of steps; and 
output means (53, 54, 504) for outputting the motion of a multiple-jointed object moving with a 
specified number of steps between a plurality of specified number of positions. 

35. A motion representing apparatus comprising: 
means (511) for Inputting a plurality of points of time; 

means (503) for specifying therefrom infonmation related to a number of steps; and 
output means (53, 54, 514) for outputting the motion of a multiple-jointed object (1) moving with a 
specified numl)er of steps between a plurality of specified number of points of time. 

36. A motion representing apparatus for representing with functions of time an action of each joint (3, 4, 
5) of a multiple-jointed object (1) comprising, output means (522, 521, 102) for outputting the motion of 
ttie object which takes a specified posture at a specified position during the movement. 

37. A motion representing apparatus for representing with functions of time an action of each joint (3, 4, 
5) of a multiple-jointed object (1) comprising, output means (522, 531, 102) for outputting the motion of 
the object which takes aspecified posture at a specified point of time during the movement. 

38. A motion representing apparatus for representing with functions of time an action of each joint (3. 4, 
5) of a multiple-jointed object (1) comprising: 

means (51. 541-546) for representing with ttie functions of time tfie motion of the object in a 
specified space; 

means (548) for achieving an interpolation on a function of time representing ttie motion of ttie object 
in a space assigned witfi a function of time representing a motion between specified spaces, tfie 
interpolation being conducted witfi a distance between tfie spaces, ttiereby generating a function of time 
representing the motion of the object at an intermediate point; and 

output means (52, 53, 54, 547) for outputting a motion of ttie object, ttie motion changing in a 
specified interval in substantially a continuous manner. 

39. A motion representing apparatus for representing witfi functions of time an action of each joint (3. 4, 
5) of a multiple-jointed object (1) comprising: 
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means (51. 551-556) for representing with the functions of time a motion of the object in a specified 
point of time; 

means (558) for achieving an interpolation on a function of time representing a motion of the object 
at a point of time assigned with a function of time representing a motion between specified points of 
time, the interpolation being conducted by use of a period of time between the points of time, thereby 
generating a function of time representing the motion of tfie object at an intemiediate point of time; and 

output means (52. 53. 54. 557) for outputting a motion of the object, the motion changing in a 
specified Interval In substantially a continuous manner. 

40. A motion representing apparatus for representing with functions of time and by use of a key frame 
method an action of each joint (3, 4. 5) of a muftiple-jointed object (1) comprising: 

means (562. 52) for separating from the representation of functions of time actions of particular joints 
of the object, thereby creating the actions of the separated joints in the key frame method; and 

means (564) for combining a representation of functions of time with a representation obtained by 
the key frame method, thereby processing a motion of the object. 

41. An apparatus according to No. 40 further Including means (571) for transforming the motions 
produced in the key frame method into functions of time and for memorizing therein the functions of 
time. 

42. A motion representing apparatus for representing with functions of time and by use of a key frame 
method an action of each joint (3, 4. 5) of a multiple-jointed object (1) comprising: 

means (581) for measuring an action of said each joint of the object; 

means (592) for transforming the measured action of said each joint Into a function of time; and 
output means (53. 54) for outputting a motion of the object depending on the function of time. 

43. An apparatus according to No. 42 wherein said transfonn means includes means (591) for con-ecting 
tile measured action of said each joint of the object and then transforms the corrected action into a 
function of time. 

44. A motion representing apparatus for representing with fucntions of time an action of each joint (3. 4, 
5) of a mumple-Jointed object (1), wherein actions of respective joints of the object are generated in a 
key frame method and then the obtained actions are transformed into functions of time, thereby 
outputting a motion of the object. 

45. A motion representing apparatus for representing with functions of time an action of each joint (3. 4. 
5) of a multiple-jointed object (1). wherein when a motion of the object Is selected, functions of time are 
created for all of said joints by use of a group of functions of time representing an identical action, 
ifiereby i)roducing a motion of the object. 

46. A motion representing apparatus for representing with functions of time an action of each joint (3. 4. 
5) of a multiple-jointed object (1). wherein when a motion of the object is selected, functions of time are 
created for all of said joints by use of a group of functions of time representing an Identical action and/or 
different actions, thereby generating a motion of the object. 

47. A computer graphic system achieving computer graphics comprising: 

a motion representing apparatus according to one of the Nos. 13 to 45; and 
a display (17, 54) for displaying the motion of the multiple-articulated object. 

48. A robot conh-ol system comprising: 

a motion representing apparatus according to one of the Nos. 13 to 45; and 
a robot (2000) being driven in association with the motion of the object. 

49. An apparatus according to one of ttie Nos. 13 to 15 wherein the primary functions of time are 
components of a function of time. 

Claims 

1. A method of representing a motion of a multiple-jointed object (1) in which an action of each articulation 
(3. 4. 5) of the object is controlled so as to present the motion thereof on a screen (17), comprising the 
steps of: 

attaining a bending angle of each said joint as a function (functions (1) to (4)) independent of a 
length between joints of the object; 

obtaining, based on the functions, data of a contour of the object in motion in response to an 
instruction; and 

displaying the contour data on the screen. 

2- A mettiod of representing a motion of a multiple-jointed object (1) in which an action of each articulation 
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(3, 4, 5) of the object is controlled to present the motion thereof on a screen (17), comprising the steps 
of: 

attaining a trending angle of each said joint as a function of time (functions (1) to (4)); 
obtaining, based on the functions, data of a contour of the object in motion in response to an 
instruction; and 

displaying the contour data on the screen. 

A method according to Claim 2 wherein the bending angle of each said joint is attained as a function of 
a phase difference (^^n). time (t). and an amplitude (A^n)- 

A method of representing a motion of a multiple-jointed object (1) in which an action of each articulation 
(3. 4, 5) of the object is controlled so as to present the motion thereof on a screen (17), comprising the 
steps of: 

attaining a bending angle of each said joint as a function (functions (1) to (4)) independent of a 
length between joints of the object; 

obtaining, based on the functions, data of a contour of the object in motion in response to an 
instruction; and 

displaying the contour data on a screen, 

said step of achieving the display on the screen t>ased the contour data being accomplished by 
altering values of the parameters (D^, Am„, ^^n. m, n, ^m) of the functions. 

A motion representing apparatus for representing a motion of a multiple-jointed object (1) in which an 
action of each articulation (3, 4, 5) of the object is controlled to present the motion thereof on a screen 
(17), comprising: 

means (10. 12) for attaining a bending angle of each said joint as a function (functions (1) to (4)) 
independent of a length between joints of the object; 

means (14) for obtaining, based on the functions, data of a contour of the object in motion in 
response to an instruction; and 

means (17) for displaying tiie contour data on the screen. 

A motion representing apparatus for representing a motion of a multiple-jointed object (1) in which an 
action of each articulation (3, 4. 5) of the object is controlled to present the motion thereof on a screen 

(17), comprising: 

means (10. 12) for attaining a bending angle of each said joint as a function to time (functions (1) to 

(4)); 

means (14) for obtaining, t>ased on the functions, data of a contour of the object in motion; and 
means (17) for displaying the contour data on the screen. 

An apparatus according to Claim 6 wherein the tending angle of each said joint is attained as a 
function of a phase difference (^mn)» time (t), and an amplitude (A^n). 

A motion representing apparatus in which an action of each joint (3. 4. 5) of a multiple-articulated object 
(1) is controlled so as to present the motion thereof on a screen (17). comprising; 

means (10. 12) for attaining a bending angle of each said joint as a function (functions (1) to (4)) 
independent of a length t>etween joints of the object; 

means (14) for obtaining, from the functions, data of a contour of the object in motion in response 
to an instruction; 

means (17) for displaying tiie contour data on a screen, and 

means (11. 13) for altering values of ttie parameters (D„,. A^„, m. n. of the functions, 
thereby changing ti)e display on the screen based on the contour data. 

A robot motion control method in which operational instructions are supplied to a multiple-jointed robot 
(1) so as to actuate the robot in a desired motion, comprising the steps of: 

attaining a bending angle of each joint (3. 4, 5) of ttie robot as a function (functions (1) to (4)) 
independent of a length between joints thereof; 

obtaining positional data of each said joint based on the function; 

creating an operational instruction for the rolxrt depending on the positional data; and 

driving the robot based on the operational instruction. 
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10. A robot motion control apparatus in which operational instructions are supplied to a multiple-articulated 
robot (1) so as to actuate the robot in a desired motion, comprising: 

store means (10) for storing therein a bending angle of each joint of the robot as a function 
(functions (1) to (4)) independent of a length between joints thereof; 

means (12) for obtaining positional data of each said joint based on the function; 

means (14) for generating an operational instruction for the robot depending on the positional data; 

and 

means (17) for driving the robot based on the operational instruction. 

11. A motion representing apparatus for representing with functions of time (functions (1) to (4)) an action 
of each joint (3, 4. 5) of a multiple-jointed object (1) on a screen (17). comprising: 

means (81) for specifying transit points of the object; 

path generate means (91) for generating a path along which the object moves between specified 
transit points; and 

output means (53, 54) for outputting a motion of the object passing at least either one of the 
specified transit points. 
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